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The results froa application of Stuff lebean"s 
conprehensive decision^naking methodology-*the 
contejct*input«process-product (CIPP) evaluation nodel — to the 
evaluation of a dental teas training program vith expanded functions 
of auxiliary personnel (paraprofessionals) at a school of dentistry 
are described. In view of the expectations of health care on the part 
of the American public, this training program was aimed at enhancing 
the capabilities of the dental profession to serve a large public at 
lover cost and vith greater efficiency vithout a reduction of quality 
in service. Thus for this innovative training program, it appeared 
essential to delineate, obtain, and provide useful information for: 
(1) planning decisions regarding appropriate change^oriented 
objectives based on a rationale of needs (facilitated by context 
evaluation) , (2) structuring decisions concerning a choice of 
alternative designs, strategies, and procedures for conducting the 
program (served by input evaluation), (3) implementing decisions 
pertaining to carrying out and monitoring the program design and 
strategy (directed by process evaluation) , and (4) recycling 
decisions concerning vhether to continue, terminate, modify, or 
refocus the change activity (aided by product evaluation) . 
(Author) 
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PurDoso. The purposa of the paper is to describe the results from appli- 
cation of Stufflebcan's ccr^prehensive decision-making methodolopy--the conttr^.t- 
input-proccss-product (CIPP) evaluation ror!Gl--to the evaluation of a dental 
team traininn prograiu with expanded functions of auxiliary nersonnel (parapvo- 
fessionals) at the School of Dentistry , of Lonia Linda University^ In view of 
heiohtened expectations of health care on the part of the Arrerican public, this 
traininq program was aimed at enhancinq the capabilities of the dental profession 
to serve a larger public at lower cost and with greater efficiency without a 
reduction of quality in service. Thus for this innovative and hopefully exem- 
plary training procraTi, it appeared essential to delineate, obtain, and provide 
useful infoy^T^ation for (a) planning decisions regarding appropriate change- 
oriented objectives based on a rationale of needs (facilitated by context 
eval uation ) , (b) structuring decision s concerning a choice of alternative 
designs, strategies, and procedures for conducting the program (served by 
input evaluation ), (c) implementing decisi ons pertaining to carrying out and 
monitoring the prorram design and strategy fdirected by process evaluation ) , 
and (d) r ecycling decisions concerning whether to continue, terminate, m.od'ify, 
or refocus the change activity (aided by product evaluation ). 



Evidence of noeds a. id ^'^■•^ortiiui tios . 

A major prcblo:] that has existed in dentistry for some tim.e is that the 
profession i.c:s not ofroctively utilized dental ai^xiliaries to maximize efficient 
use of the c.or.tist^s t.iire and skills. The medical profession has for many years 
reconnizod the need for wol 1 -qua! ified assistants who perform highly technical 
and exacting tests, as well as a great many direct treatment services. Pentistry, 
cn t'-^f} other hand, has been slcv.* to move in the traininn and use o^ paraprofes- 
slonoi:, ev:'r thcu'ih the prds^nt dontist-to-pcoul aticn ratio is approximately 
1:2,000 in tne United States. 

Response to the need . 

In 1967, the President's T'ational Advisory Commission on Health Manpower 
stated that the dental profession could only meet its com.mitment to the public 
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throL::h rorc effective use of auxiliaries {An:erican Dentril Associ:.t1or;, i370). 
Ev^ry con^prehsnsive analysis of the United States health manpower situation nas 
been in agreer:ent cn that point because it is obvious that neither increasing the 
nufTiber of dental students nor utilizinq new materials and techniques, pre- 
ventive dentistry, or conventional auxiliaries v/ill solve the problem of 
providing dental services to the increasing population of those who demand 
efficiency and economy. Therefore, the Public Health Service in 1971 developed 
the TEAM (Training in Expanded Auxiliary Manaqarent) Pronram with the intention 
of training dental students in the organization and management of a dental 
practice which uses the "terim" approach for the* delivery of quality dental 
health care. 

In the light of the needs assessment that was done, both through inter- 
views and a substantial review of the literature, a context evaluation afforded 
a basis for making decisions regarding what the goals and objectives of the TEAM 
training program should be. 

Preliminary coaTs of TEA iM. 

These seven broad objectives were that prior to the completion of his 
training with TEAM, each dental student will: 

1. Provide evidence of ability to control quality of the TEAM product. 

2. Remonstrate knowledge of the skills required of auxiliaries performing 
expanded duties. 

3. Evaluate level of perform-ance of auxiliary personnel. 

4. Provide evidence of interpersonal skills for optimum operation of the 
team. 

5. Receive feedback from patients relative to their attitudes. 

6. Demonstrate knowledge of and ability to apply basic principles of 
facilities and equipment design. 

7. demonstrate efficient manacerial ability with his team that results 
in a financial break-even level of remuneration to simulate actual 
private practice conditions. 

KIP'JT EVALUATIC;] 
(Structuring Decisions) 

In providing information for structuring decisions concerning which of 
several alternative designs and strategies could be used in program development, 
attention had to be given to (a) legality of the TEAM approach, (b) existing 
programs involving limited, but legal, uses of dental auxiliaries (known as 
Dental Auxiliary Utili;^ation [OAU] Program), (c) developir.ent of a synthesis of 
existing job descriptions o^ auxiliaries and dental hyoienists, (d) the alio- 
cation of hL.r..an and physical resources including utilization of staff and 
instrur.ental materials within the constraints of funding and performance compe- 
tencies, (e). the desinn of appropriate instruments for evaluation, and (f) the 
results of pilot studies. It was noted that managerial capabilities are required 
for both DAU and TEAM with expertise in practice manaqem.cn t becoming more 
essential as the individual dental student learns to v^ork in co-operation, first 
with one auxiliary (CAU) and then with multiple auxiliaries (TEAM). 
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C.hr.r.r:t^n-:st ics of t.-io TEAf! Prooranu 

On tUe basis of irforniaticn provider; fron input ovaluation, structuring 
decisions were made concerning what the design of the TEAIl Program would be. 
Space allocations include facilities for tv;o" teams which operate in the TEAM 
area of the Lciria Linda University, School of Dentistry clinic and make use of 
the x-ray roon. These teans function in eipht dental operatories designed in 
the bay concept (Appendix A) in v/hic!. each of tv;o senior dental sLudcnt operators 
can observe and manace the function of his six fiill-tinie equivalent auxiliaries 
(Appencix B). 

Student selection for TEA'* experience is liir.ited to those senior students who 
have cc-iplet'3:: three years of the dental curriculum, v;hich includes two years 
of clinical experience ^nd to those who are proficient in the practice of DAU 
principles. 

TEA:> Prc^ran r;Vr:^l t!?>tion nian, on the basis of decisions derived from input 
evaluation, consists of two n^ajor parts: (a) cnnoing assess:r:ent of the quali- 
tative and quantitative performance of the total tean, includinq the dental 
student and all auxiliary personnel, as well as of the attitudes of patients 
toward receivinq the experiirent^l dental services, and (b) productivity during 
sinvjlation conditions of projected TEA" private practice with the minimal 
financial qoal of a brc.ik-even level. This approach allows inferences to be 
drawn reoarding the toan's efficiency levels and production capacity. In 
addition, observations ^ire recorded regardinn the nature and effectiveness of 
the consultative process between dental student and all auxiliaries as they 
share responsibility for patient care. Thus input evaluation served to afford 
plans for both process and product evaluation to be described subsequently in 
greater detail . 

Illustrative .iob descriptions. Instead of lin^itinq auxiliary personnel to their 
traditional role which includod preparation of instruinents , ordering supplies, 
perforniing secretaricl and accounting duties, and conventional chairside assisting, 
the tea:! approach to dentistry pror;otes direct treatment services to patients 
such as having the EDDA (Expanded Duties Dental Assistant) perform the following 
intra-oral procedures: 

1. Place and re:^ove rubber dam. 

2. Take prc]i\:rir\ary alginate iiripressions. 

3. Retract tissue for final impressions. 
^. Take rubber base final impressions. 

5. Prepare, place, and rorriove all types of temporary restorations. 

6. Ccndir.se, carve, and polish aralaam restorations. 

7. Place and rerove surgical dressings. 

8. Adnir.ister fluoride treatr^ents. * 

0. l<"*::rove sutures, 

10. Assist dentist at chair during the irreversible procedures. 

11. Administer local anesthesia (infiltration and nerve blocks}. 

12. Adjust fixed restorations prior to cementation (i.e. crowns). 
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dental hyninnist Is 'responsible' for tho foncv/ina functions: 

Diotary analysis. 
Pre* ini nary ct^artirKj. 
Preliminary history. 
Takinq of radiooraphs . 
Preliniinary iirprossions . 
Instruction of patients in plaque cor^trol. 
Application o:' topical fluorides. 

Coronal dGbrider^ont, subqinqival scaling, root 'jlanino, polisln'nq. 
Assessp:ont of oral hygiene, reinstruction as indicated, 
r-drrinistration of topical anesthetics, infiltration, nerve blocks, 
f'inor periodontal surgery. 

;!otc: The Ivynienist's assis tant.wil 1 usually perform items 1-4, 
with the hyc;ienist placing her emphasis on i.tens 5-11. 

PROCESS EVALUATIOJJ 
( Irr.pl eirentinq Decisions) 

The process evaluation served to provide information re^ardinn nur.ber 
of the followinc characteristics so that decisions could be made reqardino 
alternative courses of action that could be taken to maintain and improve tlie 
quality of the pronram: (a) determination of strengths and v^oaknesses of par- 
ticipants in both tccrmical cor.^petencies and human relations-nanaocmont skills 
at various tire perio^is as revealed by data fro^* observation scales, (b) com- 
parison of scheduled attainments with actual attainments on a daily and/or 
weekly basis, (c) extent to v;hich facilities, instructional materials^ and 
supplies v;ore being used in prescribed ways and amounts, (d) the deqrce to 
v;hich the ro'es of participants v;ere urdorstood and being implemented, as well 
as the degree to which misunvlerstandings about job function and responsibilities 
existed to tho detriiront of realizing program objectives. On the basis of 
information obtained from process evaluation, particularly in relation to 
nearly sim.ul tancous product evaluation, adjustments viere :.icde in the specifi- 
city of task require.v.cnts for the student manager of the TEA*] and his personnel, 
as well as in ti^e modification of existing instrum^entation and in the design 
of new instrL'.entation for evaluation of onnoing TEAM activities. An important 
outcome of process evaluation was the decision that relatively greater em.phasis 
needed to be placed on the development of human r:jlations and managem.ent skills 
relative to efforts th(,t had been spent on clinically-oriented procedures and 
techniques of dentistry. 

PRODUCT EVALUATlOf! 
(Recycling Cecisicns) 

Preliminary inf or» Lion from performance criterion scales and from various 
observation scales obtained at the terminal points of training sessions for 
various teams has indicated: (a) paraprofessionals are capable of a level of 
success in a variety o^" dental procedures comparable to that realized by dental 
students, (b) considerable room exists for the imnrovemient of interpersonal 
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Suiil" on t!:j pnrt of most rv^ 'bcrs of the TEA-*--a Doint also reinforcod by the 
reparcs of patients on attiti;do scales, (c) favorable cost-effectiveness data 
have suggested thet increased productivity in dental services v/ith.out a loss in 
quality is probably possible v.v»en auxil iori'::S are properly trainee' and supervised, 
(d) in coniunciion v;ith process evaluation, inforniation associated with prod'jct 
evaluation revealed a need for criterion-referer.ced types of data to i.'-Iiitain 
and if^;prove .he quality of the clinically-related outcoir.es of dentist) y. 

co::cLUSiOii 

On the basis of prolin.inary evidence obtained froin the TEAM Pronrani at 
Lor:a Linda University, School of Dentistry, tv;o major conclusions seen apo^rent: 

1. The CIPP ro,c1':}l a ^'fords a useful and viable evaluation rethodoloiy to the 
dc-ter;:nnation of information required in nakino important dr^cisions in 
pUmninc^, structurinn, inplejT.entinq , and recyclino activities ir.volved in 
a tea;- prograin. 

2. Fro'^T a substantivo standpoint, application of the CIPP r.odel has furnished 
preliminary evidence tl'iat a TEA;! approach to dentistry involving the use 
of paraprofecsionc^ls holes pronnse for extendinn needed dental services 

of a hich level ov cuality to a ruc!i broa"!-:r croup of recipients thar* is 
now beinq servoci by the dental prcfossion. 
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APPENDIX B:-" 
Tea.:i Program Orrf-nizatiorval ojiiart. 
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